Instance Level Classification Confidence Estimation
نویسندگان
چکیده
Often the confidence of a classification prediction can be as important as the prediction itself although current classification confidence measures are not necessarily consistent between different data sets. Thus in this paper, we present an algorithm to predict instance level classification confidence that is more consistent between data sets and is intuitive to interpret. The results with five test cases show high correlation between true and predicted classification rate, i.e. the probability of assigning the correct class label, thus proving the validity of the proposed algorithm.
منابع مشابه
Least squares support vector machines for direction of arrival estimation with error control and validation
This paper presents a multiclass, multilabel implementation of Least Squares Support Vector Machines (LS-SVM) for direction of arrival (DOA) estimation in a CDMA system. For any estimation or classification system the algorithm’s capabilities and performance must be evaluated. Specifically, for classification algorithms a high confidence level must exist along with a technique to automatically ...
متن کاملConvex Multiple-Instance Learning by Estimating Likelihood Ratio
We propose an approach to multiple-instance learning that reformulates the problem as a convex optimization on the likelihood ratio between the positive and the negative class for each training instance. This is casted as joint estimation of both a likelihood ratio predictor and the target (likelihood ratio variable) for instances. Theoretically, we prove a quantitative relationship between the...
متن کاملEnsemble of Part Detectors for Simultaneous Classification and Localization
Part-based representation has been proven to be effective for a variety of visual applications. However, automatic discovery of discriminative parts without object / part-level annotations is challenging. This paper proposes a discriminative mid-level representation paradigm based on the responses of a collection of part detectors, which only requires the imagelevel labels. Towards this goal, w...
متن کاملIRDDS: Instance reduction based on Distance-based decision surface
In instance-based learning, a training set is given to a classifier for classifying new instances. In practice, not all information in the training set is useful for classifiers. Therefore, it is convenient to discard irrelevant instances from the training set. This process is known as instance reduction, which is an important task for classifiers since through this process the time for classif...
متن کاملA confidence-aware interval-based trust model
It is a common and useful task in a web of trust to evaluate the trust value between two nodes using intermediate nodes. This technique is widely used when the source node has no experience of direct interaction with the target node, or the direct trust is not reliable enough by itself. If trust is used to support decision-making, it is important to have not only an accurate estimate of trust, ...
متن کامل